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ON THE STRUCTURE OF SOLUTIONS OF ERGODIC 
TYPE BELLMAN EQUATION RELATED 
TO RISK-SENSITIVE CONTROL 

By Hidehiro Kaise and Shuenn-Jyi Sheu^ 

Nagoya University and Academia Sinica 

Bellman equations of ergodic type related to risk-sensitive control 
are considered. We treat the case that the nonlinear term is positive 
quadratic form on first-order partial derivatives of solution, which in- 
cludes linear exponential quadratic Gaussian control problem. In this 
paper we prove that the equation in general has multiple solutions. 
We shall specify the set of all the classical solutions and classify the 
solutions by a global behavior of the diffusion process associated with 
the given solution. The solution associated with ergodic diffusion pro- 
cess plays particular role. We shall also prove the uniqueness of such 
solution. Furthermore, the solution which gives us ergodicity is stable 
under perturbation of coefficients. Finally, we have a representation 
result for the solution corresponding to the ergodic diffusion. 

1. Introduction. We consider the following nonlinear partial differential 
equation: 

(1.1) ^Di{a'WjW) + ld'WiWDjW + b-VW + V = A in M^, 
or equivalently 

^a'Wi^W + U'WiWD^W + b ■ VW + V = A, 

(1.2) 

where a{x) = [a^^{x)], a{x) = [a*-'(x)] are symmetric matrices, 6(x) = {b^{x), 
. . . , b^{x)) is a mapping of M.^ into M.^ , and V{x) is a function on R^. Here 
we utilize the notation Dij = d'^ /dxidxj, Di = d/dxi and the summation 
convention for multiple indexes. We think of a pair (VF, A) of function W{x) 
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and constant A as a solution of (1.1). Equation (1.1) is called an ergodic type 
Bellman equation. Such equations have been treated in ergodic control prob- 
lems (cf. [1]). In ergodic control problems, a is negative- definite and more 
general forms of (1.1) have been studied under rather general conditions 
(cf. [2]). On the other hand, (1.1) also appears in risk-sensitive problems 
in infinite time horizon and has been studied under certain conditions (cf. 
[10, 13, 14, 20]). One of the main features of (1.1) in risk-sensitive control 
is that a might be indefinite. Indeed, the following equation is studied in a 
risk-sensitive control problem (see [10]): 

(1.3) la'WijW + ^a'WiWDjW + mi{f{x, z) ■ VW + L{x, z)} = A, 
2 2 z&z 

where / : x Z ^ R^, L : x Z ^ M, Z is a Borel subset in M^^ and 9 
is a constant in M\{0} which is called a risk-sensitive parameter. Equation 

(1.3) is considered to characterize a logarithm-exponential type criterion per 
unit time on infinite time: 

(1.4) A = inf liminf logE[e'^ -fo 

where is a controlled diffusion process satisfying 

dXt = !{Xt,zt)dt^G{Xt)dBu Xo = xeM^, a'\x) = {cja'^)'\x), 

\Bt\ is standard Brownian motion and {zi} is a Z-valued process which 
is considered as a control. The infimum in (1.4) is taken over some class 
of {2;*}. In particular, if we take f{x,z) = b{x) + C{x)z, L{x,z) = V{x) + 
(1/2) z'^ S{x)z, Z = R^, where C{x), S{x) are matrices with suitable di- 
mension and S{x) is positive-definite, then (1.3) reads 

^a'WijW + i(^a - CS^^C^yWiWDjW + b ■ VW + V = A. 

Note that the sign of nonlinear term a = 6a — CS~^C'^ depends on 9. We also 
remark that the infimum in (1.3) is attained ai z = —S{x)~^C{xyVW{x). 
We are concerned with the case that 6a — CS~^C'^ is positive-definite since 
in this paper we shall study the solutions of (1.1) in the case that a is 
positive-definite. Recently, it has also become known that this case happens 
in some investment problems in mathematical finance (cf. [3, 8, 11, 12, 21]). 
However, we remark that, unlike these papers, the verification theorem will 
not be considered in this paper. The verification theorem is to show A in 
(1.4) is equal to A* in Theorem 2.6 and 

zl = -S{Xtr^C{XtfVW*{Xt) 

is a feedback optimal control, W* is a solution corresponding to A* \W* is 
usually unique if M/^*(0) = 0]. See also [15] for some examples from investment 
problems. The relation between the drift term aVW* in (1.8) for W = W* 
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and as well as its role in the risk-sensitive control problem can be seen 
from the arguments in [11, 12]. The main merit of our study is to show 
that multiple solutions exist in general for such equations. We also provide 
particular solution(s) that is(are) responsible for the verification theorem. 
We observe that the case when Oa — CS~^C'^ is negative-definite can also 
be treated by considering the equation for {—W). Therefore, according to 
Theorem 2.6, we have the following interesting observation. Assume ci < 
a{x) < C2 and ci < C{x)S{x)~^C{x)'^ < C2 for some constants ci,C2 > 0. 
Then for small 6 > 0, there is A* (depending on 9) such that the above 
equation has solution if and only if A < A*. For large 9 > 0, there is A* 
(depending on 9) such that the above equation has solution if and only if 
A > A*. In a risk-sensitive control problem, it is more interesting to assume 
V{x) — > oo as \x\ — > oo. In this case, it may happen that A* = oo for large 6. 
See some discussion in [20] . 

As we mentioned in the above, the studies of solutions for Bellman equa- 
tions from an analytical point of view are considered to be fundamental to 
determine an optimal control. Note that solutions of (1.1) have ambiguity 
of additive constant, that is, if (W, A) is a solution of (1.1), W{x) + c still 
satisfies (1.1) for each constant c. As some examples show, it is known that 
(1.1) has multiple solutions even if we identify the solutions up to additive 
constants. So, it is important to study how we pick up a particular solution 
of (1.1) which gives an optimal control for the problems at hand. A common 
way to obtain a particular solution for ergodic type Bellman equations is to 
study the discounted type equations. The discounted type Bellman equation 
corresponding to (1.1) is as follows: 

^Di{a'WjWa) + ^a'WiWaDjWa + b ■ VWa + V = aWa- 

a > is called a discount factor. Under certain conditions, it is shown that 
Wci{x) — VFa(xo) normalized at some point xq G and aWa converge to 
some function W{x) and some constant A, respectively. Furthermore (W^, A) 
satisfies (1.1) (cf. [10, 13, 14]). Under the conditions including the linear ex- 
ponential quadratic Gaussian (LEQG) control problem, we need to consider 
the case that h{x) [resp. V{x)\ is at most linearly growing (resp. quadrati- 
cally growing). Under such settings, W is characterized to meet some growth 
condition and {W, A) obtained by this procedure is considered to be the right 
solution (cf. [13, 14]). 

In the present paper we directly tackle (1.1) without the procedure us- 
ing the discounted type equation under the conditions including the LEQG 
case. We shall specify the set of A for which (1.1) has a smooth solution. 
Furthermore we shall characterize the set of A by noting the global behavior 
of diffusion process which is related to some control problem. 

To explain how we relate (1.1) to a control problem, we shall give a 
control interpretation to (1.1). Let (17, T, P, {J~t}) be a probability space with 
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filtration. Consider the following controlled stochastic differential equation 
(SDE): 

dXt = (b{Xt) + ut) dt + a{Xt) dBt, Xo = X G M^, a{x) = a{xf/'^, 

where {Bt\ is A^-dimensional {.T-j }-Brownian motion and {u^} is an 
{^f }-progressively measurable process taking its value in R^. {ut\ is con- 
sidered as control process. We define the value function as follows: 

cT-t 



v{t, x) = sup-E^ 



I ~ {V{Xs)-ld-/{XMvi)ds 



where d^j^ is the (z, j)-component in inverse of d. By using the Bellman 
principle, we see that v{t,x) satisfies the following equation formally: 

dv 1 ( ~ 11 

— + -a'WijV + sup <^ {b{x) + u) ■ V^v - -dj^^'u^ } + V = 

dt 2 ^gjjiv L 2 ) 

(1.5) 

in (0,r) X R^, 

(1.6) v{T,x) = 0, xGM^. 

Since sup„gK^{(6 + u) ■ V^v - {l/2)d;j\'u^} = {l/2)d'WivDjV + b ■ V^-u, 
(1.5) reduces to the following: 

+ -a'WijV + -d'WivDjV + b-V^v + V = 0. 

Note that the supremum is attained at u(t, x) = d{x)S/xv{t, x). U — {dv/dt){0, x) 
converges to some constant A and v{0, x) — v{0, xq) normalized at some point 
xq € converges to some function W{x) as T — > oo, we have formally the 
following equation which we shall discuss in this paper: 

\a'Wi.jW+ ^d'WiWDjW + b ■ VW + V = A. 

This is considered to characterize the long-time average cost defined as fol- 
lowing: 



1 

(1.7) A = suplimsup — -E^ 

u. T^oo T 



T 



ViXs)-h;^{XsHui^ ds 



Following the Bellman principle, we can expect that ut = d{Xt)'\7W{Xt) 
should be a candidate of optimal control for (1.7), where {Xt} is defined by 
the controlled SDE with ut = Ut = d{Xt)VW{Xt): 

(1.8) dXt = {b{Xt)+dVW{Xt))dt + a{Xt)dBt, Xo = x. 

We shall study the structure of solutions of (1.1) by relating to (1.8) under 
conditions which include the LEQG case, that is, b{x) [resp. V^(x)] has at 
most linear growth (resp. quadratic growth). 
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The paper is organized as follows. 

In Section 2 we shall specify the set of A for which (1.1) has a solution 
under rather general conditions on b{x) and V{x). Indeed, it is proved that 
the set of A is equal to closed half-line [A*,oo) for some A* S (—00,00). 

In Section 3 we shall classify A according to the global property of the 
diffusion process defined by (1.8). We shall prove that for A > A*, the diffu- 
sion process {Xt} in (1.8) corresponding to solution (VF, A) is transient and 
for A = A*, {Xt} is ergodic. Moreover, we shall show that solution W{x) 
corresponding to A* is unique up to additive constant. 

We show the structure of solutions in Sections 2 and 3. In Section 4 we 
shall consider the problem that the structures specified in Sections 2 and 3 
are preserved under the perturbation on coefficients in (1.1). More precisely, 
consider (1.1) with a = a„, a = an, b = bn, V = Vn- 

\Di{4DjWn) + \a'WiWnDjWn + b ■ VWn + Vn = K- 

In similar ways to Sections 2 and 3 we can find [A*, 00) for (1.1) parame- 
terized by n and solution Wn corresponding to A* is unique. In Section 4 
we mainly study the case that an = a, a„ = a, bn = b, independent of n, and 
shall show that if Vn converges to A* converges to A* and unique solution 
Wn corresponding to A* converges to unique solution corresponding to A*. 

In Section 5 we shall study the representation for A* . To obtain the repre- 
sentation result, we consider perturbation on V and notice the dependence 
on V for A*. By using the representation, we can prove the moment condition 
for invariant measure of the ergodic diffusion process in (1.8) corresponding 
to A*. 

Last, we mention the connection to positive solutions of linear equa- 
tions. Suppose a^^{x) = a^^{x), i,j = l,...,N. If we take the transformation 
4>{x) = e^^^^ in (1.1), we have 

(1.9) ^a'Wij^ + b-Vcl) + V(l) = A(j). 

Thus, in the case that a^^{x) = a^^{x), the study of solutions for (1.1) re- 
duces to that of positive solutions for (1.9). We note that the structure of A 
specified in this paper is considered to be a generalization in the theory of 
positive harmonic function for linear differential operators (cf. [22]). Some 
applications of our results to the evaluation of large time asymptotics of 
expectations of diffusion processes will be given in [17]. 

2. Set of A with solutions. In the present section we shall consider the 
set of A for which (1.1) has a classical solution W under rather general 
conditions. In the next section we shall classify A by following the global 
behavior of the diffusion process related to the solution W corresponding 
to A. 
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We define the following set: 

(2.1) ^ = {A: there exists smooth function W satisfying (1.1) for A}. 

Under the assumptions given below, we can prove that A has the following 
form for some A* E (— oo,cx3): 

^= [A*,oo). 

For simplicity, we always assume a*-', a*-', b, V are sufficiently smooth. We 
shall give the following assumptions: 

(Al) There exist < z^i < 1^2 such that 

(A2) There exist < ni < fi2 such that 

(A3) There exists a smooth function Wo{x) such that 

^Di{a'WjWo) + ^a'WiWoDjWo + b-VWo + V ^ -00 as \x\^oo. 

Remark 2.1. Note that it follows from (Al), (A2) that there exist c, 
c > such that 

(2.2) ca{x) <a{x) <ca{x), xGM^. 

Remark 2.2. In the following, we give some interesting examples for 
(A3). 

(a) Assume aij{x),aij{x) are bounded together with their derivatives. 
Assume also that there are ccTq > such that 

6(x) • X < — co|xp, |x|>ro. 

(b) Assume ajj(x), Ojj(x) are bounded together with their derivatives. 
Assume also that there are cctq > such that 

6(x) • X > co|xp, |x|>ro. 

(c) Assume V{x) —00 as |x| — s- 00. 

For (a), we take Wq{x) = c|xp for small c > 0. For (b), we take Wq{x) = 
— c|xp for small c> 0. For (c), we take Wq = 0. 

Remark 2.3. For the purpose of discussion in the present section, we 
can replace (A3) with the existence of a super solution of (1.1) for some A 
to ensure that 0. We need (A3) to classify A in the next section. In 
the following, we show for any A and R> 0, we can construct a subsolution 
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of (1.2) in Bj^ with boundary value Wq on dBj^, where Bj^ is open ball 
with radius R centered at 0. Indeed, we consider linear partial differential 
equation with Dirichlet boundary condition: 

\Di{a'WjWQ) + h-VWo + V = k in 5^, 

Wo{x) = Wq{x) ondBf^. 

Under (Al) and smoothness of coefficients, we have unique solution 
Wo G n C{B^). By (A2), we have 

^Diia'WjWo) + ^a'WiWoDjWo + b ■ VWo + V>A in fi^. 

In order to see 0, consider the following Dirichlet problem: 

(2.3) iDiia'WjWR) + ^a'WiWnDjWR + b ■ VWr + V = A in Br, 

(2.4) Wr = Wo on dBR, 

where Br is open ball with radius R centered at and Wo is taken from 
(A3). Note that (2.3) is equivalent to 

(2.5) la'WijWR + ^a'WiWRDjWR + b ■ VWr + V = A in Br. 
By (A3), Wo satisfies the following inequality for some A: 

lDi{a'WjWo) + la'WiWoDjWo + b ■ VWq + V<A in M^. 

Also, from Remark 2.3, we see that for R> R, there exists a smooth func- 
tion Wo{x) such that 

iDiia'WjWo) + ^a'WiWoDjWo + b ■ VWq + V>A in S^. 

Then, under (A1)-(A3), there exists Wr G C^^'^iBR) satisfying (2.3) and (2.4) 
(cf. [18], Chapter 4, Theorem 8.4). 

We need a uniform bound for VWr on compact sets to obtain a solution 
W of (1.1) by sending the radius ii to oo. The following gradient estimate 
is also useful in the later discussions. 

Lemma 2.4. Let Wr be a smooth function satisfying (2.3) in Br. Under 
(Al) and (A2), we have for each r > and R> 2r 

(2.6) supIVWr^ <Cr + CA, 

Br 

where C is a nonnegative constant independent of r and R, and Cr is a 
constant depending only on r. 
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Proof. Equation (1.1) has the nonhnear term similar to those treated 
in [13, 14] and we can follow the same arguments to obtain the gradient 
estimate. However, we shall give a proof to specify the dependence of A. 

We set W = Wr for simplicity. By differentiating each side of (2.5) on Xk, 
we have 

^Dktt'WijW + ^a'WijkW + ^Dka'WiWDjW 

^^"'^^ + a'WiWDjkW + Dkb'DiW + b'DikW + DkV = 0. 

Let us set G = (1/2) J2k{DkW)^ . Then, using (2.7) 
-^a'W.jG - a'WiWDjC - ¥d,G 

= -la'WkWDijkW - la'WkiWDkjW 
(2.8) - a'WiWDkWDjkW - bWkWDikW 

= ^Dka'WkWDijW + ^Dka'WiWDjWDkW 
+ Dkb'DiWDkW + DkVDkW - ^a'Wk^WDkjW. 
We note the second-order derivative terms. Then, we have 

RHS of (2.8) <^[J2 \Da^^A | + ^\D'^W\'^ 

2 

+ DkVD^W - ^a'WkiWDkjW - ^a'Wk.WDkjW 
<^\Y. \Da'^n \DW\^ + ^Dka'WiWDjWDkW 

+ D^VD.WD^^W + D^VDkW - ^a'Wk^WDkjW, 

where (5 > is a small constant. Indeed, we can take 6 satisfying S < vi. From 
matrix inequality {tr AB)^ < Ni'2{tic AB"^) where A, B are x A^-symmetric 
matrices, A is nonnegative-definite and 1^2 is the maximum eigenvalue of A, 
we finally obtain the following inequality: 

--a'WijG - a'WiWDjG - VDiG 
(2.9) ^ 

< Cr\DW\ + Cr\DW\^ + GrWWf - ^T^ia'^ Di^Wf in B2r. 

ANv2 

Here and in the proof below, we suppose that Cr is constant depending only 
on r and G is nonnegative constant independent of r and R. 
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Fix arbitrary ^ E -Br and take a cut-off function if € Co°(M^) satisfying 
the following: 

0<(/7< 1 in M^, ^{i) = l, ip = Q\nBr{iY, 

(2.10) 

|V(/j| <Cv7i/^ |Z)Vl<C', 

where Br{C) is open ball with radius r centered at ^. Let xq be a maximum 
point of (pG in Br{£,)- By the maximum principle, we can see 

< -la'Wiji^G) - a'WiWDji^G) - b'Di{^G) 
= ^{-\a'WijG - a'WiWDjG - b'DiG} 

(2.11) - \a'^{Dij<p)G - a'WiipDjG - a'Wj^{DiW)G - b'{Diip)G 
< ip{-^a'WijG - a'WiWDjG - UDiG] 

+ CrG + C^^/^G^/^ at xo, 

where we used = D{(fG) = GD(p + (fDG and (2.10). From (2.5) and (2.9), 
it is implied that 

RHS of (2.11) < (^jCrG^/^ + + CrG^/^ - J^i^^^^^ij^f 
+ CrG + C^^/^G^^^ 

(2.12) =^I^CrG^/^ + CrG + CrG^/^ 

^ ^ la'WiWDjW -b'DiW -V + A 



Nu2 V 2 

+ C,.G + C(^l/2(^3/2 ^^^^^ 

By (A2), the following inequalities hold for some positive constant k which 
depends on ^ui, 

-]^a'WiWDjW - VDiW -V + K 

(2.13) <-^\DW\^ + Cr\DW\-V + K 

<-k\DW\^ + Cr-V + k. 
In the case that — + Cr — V + K>^ at xq, we have 

li\DW\'^{xQ)<Cr-V{xQ)+k<Cr + K 

where we used xq G i?2r • Since 

\\DW\\i) = \\DWWi)^{0 < G{xo)^{xo), 
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we obtain the following gradient estimate at ^: 

K\DW\^{i)<Cr+IV. 

We next consider the case that 

-k\DW\^ + Cr-V + K<Q atxQ. 

By (2.13), 

RHS of (2.12) 

< iflCrG^/'^ + CrG + CrG^/'^ - -^{-k\DW\^ + Cr-V + kf 

(2.14) + + 

< JCrG^I^ + GrG + GrG^'^ - ^G^ + -^G{Gr - y + A) 1 

If a - y + A > kG(xo)/4 or Gr > G{xo) we have the bound \DW\'^{0 < 
Gr + CA in the same way as the above case. We shall consider the case that 
Gr-V + A< kG{xo)/A and Gr < G{xo). Then, from (2.14), we have 

< + CrG + C,G3/2 - + 

L NU2 NV2 J 

+ CrG + G^^/^G^/^ 

< -Gi^G^ + C2V?^/^G3/^ + CaCrG 

= -Gi^G^ + C2V?i/2g3/2 + C3G at xo,C3 = G^Gr, 

where Ci, C2, C3 are positive constants independent of r, i? and A. By 
setting X = lp^/'^{xq)G^/'^{xq), we have 

Q<-GiX'^ + G2X + C3. 

Therefore, we have 

X =^G{xq)<-^ + — <-^ + —^. 

Since (1/2)|L»VF|2(^) = (1/2)|L»VF|2(^)(^2(^) < G(xo)^(xo), we obtain the 
bound for \DW\{i). □ 



Remark 2.5. Under some growth conditions for coefficients of (1.2), 
we can obtain growth order for gradient of solutions. For instance, besides 
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(Al), (A2), suppose the following growth conditions: Da^^ (x), Da^^ (x) are 
bounded and there exist ci, C2 > and m>l such that 

\bix)\ < ci(l + \xn, \Db{x)\ < ci(l + Ixp-i), 

\V{x)\ < C2(l + \DVix)\ < C2(l + Irrp— 1). 

Then, in Lemma 2.4, we can take = C(l + r^™), that is, 

sup|VVFRp<C(l + r2™ + A), < 2r < fl. 

We may normalize Wr as VFr(O) = because (1.1) does not include a 
zeroth term on Wr. Then, from Lemma 2.4, there exists W € C(]R^) such 
that Wr converges to W on each compact set as i? — > oo by taking a subse- 
quence if necessary. Also, since {WR}R^2r is bounded in H^{Br) by Lemma 
2.4, Wr converges to L^^^-strongly and if /q^,- weakly. Furthermore, we can 
see that VWr converges L^^^-strongly in a similar way to Lemma 2.8 in [14] 
and Section 1.4 in [20]. 



We rewrite (2.3), (2.4) in integral form: 

-^J a'WiWRDjipdx + \ J a'WiWRDjWRipdx 

+ J b-VWRipdx + J Vipdx = J Aipdx, ip^C^iBR). 

Fix r > 0. Since Wr converges to W -ffjQj.-strongly, we obtain the following 
by sending i? to oo: 

-^J a'WiWDj^dx + \ J a^WiWDjWifdx 

+ J b-VWipdx + J Vipdx = J Kipdx, ip £ C^{Br),r > 0. 

Owing to the regularity theorem of elliptic equations and the imbedding 
theorem, we have as a classical solution of (1.1). Therefore, we have 
proved that 0. 

We shall state and prove the form of the set of A. 



Theorem 2.6. Under the assumptions (A1)-(A3), there exists A* € 
(— c«, oo) such that A = [A* , oo) . 

Proof. In order to show inf A > —oo, we suppose inf A = — oo, that is, 
there exists {A„} C A such that A„ tends to —oo as ?i ^ oo. Let Wn be a 
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solution of (1.1) corresponding to A^. Then, by the integral form of (1.1), 
we have 



-i J a'WiWnDj^dx + \ J a'WiWnDjWnifdx 

+ J b-VWnfdx + jVipdx = J Anfdx, V? G 



Take ip G C^(]R^) such that Jtpdx^O. Since {A„} is bounded from above, 
it is implied from Lemma 2.4 that 

(2.16) sup|VW„| <C,., 

Br 

where Cr is a constant independent of n and r is taken such that supip C Br- 
Therefore, the left-hand side of (2.15) is bounded on n. On the other hand, 
the right-hand side of (2.15) is unbounded because of the assumption which 
we made above. This leads to a contradiction. 

We shall next prove ii A G A, then [A, oo) C A. Let be a solution 
corresponding to A. For arbitrary A > A, we have 

(2.17) lDi{a'WjW) + ld'WiWDjW + b-VW + V = A<A in M^. 
By Remark 2.3, for R> R, there exists Wq such that 

(2.18) ^Di{a'WjWo) + ld'WiWoDjWo + b-VWo + V>A in 5^. 

Consider the Dirichlet problem (2.3) with boundary condition Wr = Wq 
on dBpi. From (2.17), (2.18), the existence of a classical solution for this 
Dirichlet problem is guaranteed by Theorem 8.4, Chapter 4 in [18]. In the 
same manner as that right after the proof of Lemma 2.4, we can see that 
there exists a smooth function W satisfying (1.1) for A. 

We shall prove that A* = inf ^ actually belongs to A. {An} is a sequence 
in A such that A„ — > A* and Wn is a solution of (1.1) corresponding to A„ 
normalized as Wn{0) = 0. Then, Wn satisfies (2.15). Since {A„} is bounded, 
it follows from Lemma 2.4 that (2.16) holds for some constant Cr indepen- 
dent of n. Following the same way as the discussion after Lemma 2.4, we can 
see that a sequence of Wn converges to W* G C(M^) uniformly on compact 
sets and i?jQj.-strongly. By taking a limit in (2.15) as n — > oo, we have 

-| J a'WiW*Djipdx + ^ J dDiW*DjW*ipdx 

+ J b-VW*ipdx + J Vipdx = J A*ipdx Vv3GC^(M^). 

Therefore, the existence of a classical solution W* of (1.1) for A* follows from 
the regularity theorem of elliptic equations (see Theorems 5.1, 6.3, Chapter 4 
in [18]). □ 
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3. Classification of solutions. 

3.1. Transience and ergodicity of diffusion processes. In the last section 
we proved that the set of A for which (1.1) has a smooth solution is ^ = 
[A*,cxo) for some A* G (—00,00). In the present section we shall study the 
classification of A by global behavior of {Xt} defined by (1.8). 

Let (il, P, {J-^t}) be a filtered probability space on which A^-dimensional 
Brownian motion {Bt} is defined. For given A € [A*, 00), consider the SDE: 

(3.1) dXt = {b{Xt) + aVWiXt))dt + aiXt)dBt, Xq = x, 

where W{x) is a solution of (1.1) corresponding to A. We shall classify A 
according to the global properties of {^t}- More precisely, we shall prove 
that for A > A*, {Xt} is transient and for A = A*, {Xt} is ergodic. Note that 
solution of (3.1) might explode in finite time. 

We shall next discuss transience of {Xt} for A € (A*, 00). We introduce 
the operator associated to solution (VF, A) of (1.1): 

'V(^) = E^[f{Xt);t< Too], / G C7o(M^), 
Tn = m.i{t;Xt ^ S„(0)}, Too = lim r„, 

n — >oo 

where {Xt} is a solution of (3.1) up to t < Too corresponding to {W,k). 

Lemma 3.1. Under (Al)-(A3), the following inequality holds for each 
solution (W,A) of (1.1).- 

'^/(x) < A.(x)e-'=(^-^*)*, / G Co(]R^), / > 0, 
where c is in Remark 2.1 and k{x) is a constant depending only on x. 

Proof. Let W* be a solution of (1.1) corresponding to A*. We set 
Wc = cW, W* = cW*, where c > is taken from Remark 2.1. Then, we have 
from (1.2) 

(3.2) ^a'WijWc + ^a'WiWcDjWc + b ■ VWc + cV = cA, 

(3.3) ^a'WijW* + ^a'WiW*DjW* + b ■ VW* + cV = cA* . 
Subtracting (3.3) from (3.2), 

^a'W,j{Wc - W*) + (6 + dVW*) ■ V{Wc - W*) 
+ ^dV{Wc - W^) ■ V{Wc - W*) = c(A - A*). 
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Setting W = Wc-W*, we have 

(3.4) ^a'WijW + (b + aVW*) ■ VW + ^a'^W ■ VW = c(A - A*) 

We consider (3.1) and rewrite this as follows: 
dXt = ib{Xt) + dVW{Xt)) dt + a{Xt) dBt 

= {b{Xt) + dVW{Xt))dt - aVW{Xt) dt + a{Xt) dBt + aVW{Xt) dt 



ib{Xt) + dVW*iXt))dt+{ hvW{Xt)-aVW{Xt)]dt + a{Xt)dBt, 



where 



(3.5) Bs = Bs+ r aVW{Xr)dr, s<To 

Jo 

Define measure P on J^j:^^ = TthT^ '■ 



dP 
dP 



= exp 


[-1 


■'t 





aVW{Xs)l^s<r„} dBs aVW-VW{Xs)l{s<rr.} ds 



Then, P is probability measure and {B./^^-^Jg = = s A t„. By (3.5), 

we have 

E,,[f{Xt);t<Tn] 

(3.6) = E,, [f{Xt)e^o -VW'(X.)l(.<.„} dB. + (l/2) /J aVW-VW{X.)l,,^^„y ds,^^ 

where denotes expectation with respect to P. Applying the Ito formula 
to W{Xt), 

dW{Xt) = VW ■ (i + aVW* + ^dVW - aVW^ (Xt) dt 

+ ^a'WijWiXt) dt + aVWiXt) dBt 

= {^a^WijW + {b + dVW*) ■ VW^ {Xt) dt 

+ {^dVW ■ VW - aVW ■ VW^ {Xt) dt + aVW{Xt) dBt 

—aVW ■ VW + c(A - A*)^ (Xt) dt 
2c J 

+ (-dVW ■ VW - aVW ■ Vw] {Xt) dt + aVW{Xt) dBt 



(3.7) 
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= a'^WiXt) dBt - ]^aVW ■ VW{Xt) dt 

+ ^ Qa - VW ■ VW{Xt) dt + c(A - A*) dt. 
Here we used (3.4). Then, by (3.6) and (3.7), we have 

E,[f{Xt)-t<Tn] 

^£;^[y'(j^^)g-c(A-A*)t+W^(X0-VK(x)+(l/2) /J(a-(l/c)a)Viy.VW(X.)l{,<,„} d^. 

t<Tn] 

< II f ||^e™P^'^(^''~'^'^^'''^^'^"PP'''^ 



^ g-c(A-A-)t^^[g(l/2)/^'(a-(l/c)a)Viy-Viy(X,)l{,<,„}d..^ ^ ^^^^ 

Since ca{x) < a{x), we have 

E,[f{Xty,t<Tn]<k{x)e~<^-^*'^\ 

fc(x) = ||/||ooexp( sup {W{y)-W{x))). 

VyGsupp/ / 

Taking the hmit as n — oo, we obtain 

i^,[/(Xt);t <roo] < A;(x)e-^(^-^*)*. □ 

Now we have the result on transience. 

Theorem 3.2. Let {W,A) be a solution of (1.1) and {Xt} be a solution 
of (3.1) corresponding to {W,A). If (Al)-(A3) hold, then for A > A* , {Xt] 
is transient. 

Proof. Let / G Co(lR^) and / > 0. Since A > A*, we can see that by 
Lemma 3.1, 

r T^'^f{x)dt<oo. 
Jo 

Therefore, {Xt} is transient. □ 

We proved that for A > A*, {Xt} defined by (3.1) is transient. We next 
show that if A = A*, the corresponding diffusion process {^f*} satisfying 
(3.1) is ergodic. 

We have to show the following proposition. 
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Proposition 3.3. Let (W, A) be a solution of (1.1) and let {Xt} be the 
corresponding diffusion process defined by (3.1). Assume (Al)-(A3). If {Xt} 
is transient, then there exists a > such that 

'^/(x) < C(x)e-*, / G C7o(M^), / >0,xe M^, 

where C{x) is a constant independent oft, but depending on x. 

We prepare several lemmas to prove the above proposition. 
Let {W,K) be a solution of (1.1) and {Xt] be a solution of (3.1). We 
define occupation measure for {Xt} on {t < t^o} as follows: 



fit{B) = l f\B{Xs)ds, BEB{m^),t 
t Jo 



where B{R^) is the Borel cr-field on R^. Let A4i(]R^) be the set of probabil- 
ity measures on B(R^). We think of Mi(R^) as the topological vector space 
with topology compatible to weak convergence. Note that nt S A^i(M^) on 

{t<Too}. 

The following lemma on large deviation type estimate is useful. 

Lemma 3.4. Let {Xt} be a solution of (3.1). Then, the following esti- 
mate holds: 

limsup-logP[/it £]C,t < Too] < — inf /^(/^) 

t^oo t mG/C 

(3.8) 

/C is compact set in A4i{W^). 

I^ ifi) is defined as follows: 

I^(//) = -inf y" ^{x)n{dx), L = \a'Wij + {h + aVW)-V, 

U = {uG C^(M^) : u{x) > for all x, Lu/u is bounded above}. 

Note that I^(/i) takes values on [0, oo] and is convex, lower semi-continuous 
on Ali(M^). This type of estimate is well known in large deviation theory. 
As noted in [5], even if the state space of {Xt} is not compact, (3.8) holds 
for compact set fC (cf. comments in Section 7, page 440 of [5] and see the 
proof in Section 2.2 of [4] for Brownian motion). 

Lemma 3.5. If I^{fi*) = for some fi* £ Mi(R^), then diffusion pro- 
cess {Xt} defined in (3.1) does not explode infinite time. 

Proof. From assumption /^(^u*) = 0, it is implied that 

— dfi*>0 VuGU. 
u 
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For u G C^(R^), u>0, and constant c> 0, 
a f, J* u + c,^ f J* Lu 



' u f L{T^ ' u + c) 



«'^* = / ^WA ^ ^/^ 



/ M + C 



Since T^'^u + c^U, we have 



, log ^ ^ dfi* > Vt. 
at J u + c 



Thus, we can see that 



(3.10) 



log ■ dn > / log — ■ dfi 

u + c J u + c 



/log^dM* = 0. 



Let {(j)n{x)}'!^=i be a sequence in Cq°(M^) such that < (pnix) < 1 and 
(j)n{x) 1 1 as n — > oo. If we take u = (pn in (3.10), then we have 



bmce ij (pn < J^t 1) 



log — - — ■ dfi >0. 

(pn + C 



log\^dt,*>0. 

(Pn + C 



i>n + C 

By taking the limit as n ^ oo, we obtain 

Noting that + c)/(l + c) < 1, we can see that 

1 = 1, /i -a.s. 
Since the diffusion process is nondegenerate [see (Al)], 

rj^'^i(x) = i Vxe]R^,vt>o. 

Finally, as t ^ oo, we have 

Px[too = oo] = lim Px[t < Too] = hm T^'^l{x) = 1. □ 

t— >oo i— »oo 

Lemma 3.6. Let {Xt} be a solution of (3.1). If = 0, then //* is 

an invariant measure for {Xt}. 
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Proof. Since (fi*) = -infueu KLu/u){x)fi*{dx) = 0, 

/J q. 
— {x)ii*{dx)>Q yueU. 
u 

Setting w = logu, we have 

(3.11) j {Lw{x) + \aVwVw{x))^*{dx)>Q, u = e'"eU. 
Denote U by 

U = {u(^ C2(]R^); 3 ii > r > s.t. r < u{x) < R, 

Du,D^u have compact support}. 

Note that U CU. It is easy to see that if u = e'^ gU, then ux = e^^ G U for 
A € M. Therefore, applying Xw in (3.11) instead of w, 

Lw{x) + ^aVw ■ Vw{x)^ fi*{dx) > 0, u = e'" eU,X>0. 

Taking the limit as A — > 0, we have 

J Lw{x)fi*idx)>0, u = e'"eU. 

Since u = (zU implies n_i = e^"" G U, we obtain the following equation: 

J Lw{x)fi*{dx)=0, u = e'"eU. 

Noting that C^(M^) is included in {-u; : u = e"" eU}, fi* satisfies the fol- 
lowing partial differential equation in distributional sense: 

L*fi* = in M^, 

where L* is a formal adjoint of L. Since we assumed the coefficients of L are 
sufficiently smooth, fj,* has a density p*{x) and p* satisfies 

L*p* = in M^. 

Here we recall that diffusion process {Xt} does not explode in finite time 
because of Lemma 3.5. Then, by slight modifications of the Theorem in 
page 243 of [24] to the case that the second-order term of L is divergence 
form, fj:*{dx) =p*{x)dx is actually an invariant measure. □ 

Proof of Proposition 3.3. Let us define Uq as follows: 

Uo{x) = -i^a'WijWo + iaVWo ■ VWq + b ■ VWq + V), 
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where we take Wq from (A3). By setting Wq^c = cWq and Wc = cW, we have 



(3.12) 



^a'WijWo,c + ^aVW^o.c • VVFo,c + b ■ Vt^o,c + cV = -cUq, 

-a'WiiWc + —aVWc ■ VWc + b ■ VWc + cV = cA, 
2 2c 



where c is in Remark 2.1. In the above equations, subtracting each side of 
the equations, 

^a'W,j{Wo,, - Wc) + (6 + aVW) ■ (VW^o,c - VW^) 

+ ^a{VWo,c - VVFe) • (VH^o.c - VW^) = -c{Uo + A). 
Define cj) as (p = e'^o>'=~^'=. Then, we have 

(3.13) ^a'Wij^ + (b + aVW)-V^ + ^{{a-ca)V^-V^)i = -c{Uo + A)^. 
2 2c (p 

Let {Xt} be a solution of (3.1). By the Ito formula and (3.13), 

d(0(Xt)e/o^(^«(^»)+^)^^) 



-a'Wij^ +{b + aVW) ■ V4> + c{Uq + A)(^ 



2c (t!) 



Since ca(3;) < a{x) and > 0, we obtain 



(3.14) (^(Xj)e/o '=(f^o(^.)+A)d. < ^(^^ ^ 

By using stopping time t A r„ in (3.14), 

E..[<A(Xi^.Je/o""^(^o(^^)+^)'^^] < ^(x). 
Then, as n — > cxo, we have 

(3.15) i?,[<^(Xt)e/o^(^o(^=)+^)'^^;t <roo] <,^(x). 
Let Cm be a subset in A^i(M^) defined as follows: 

= G A^i(M^) : ^{Bi) >l- 5i\/l>m}, m > 1, 
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where {61} is a sequence such, that 61 — > and determined later. Note that Cm 
is a relative compact set in A^i(M^) because Cm is tight. From the definition 

r rrW,A f 

oiTf f, 

T^'^fi^) = E^[f{Xt);iit €Cm,t< Too] 

Too] 

< \\f\\oc>Px[f^t(^Cm,t<Too] 

(3.16) +E^[f{Xt);^lt^Cm,t<Too], 

< \\f\\ooPx[^J't €Cm,t< Too] 

+ 11/0-^ WooE^^iXt); fit ^Cm,t< Too], 

/gCo(]R^),/>0. 

We shall prove that Ex[(j){Xt); Ht ^ Cm,t < Too] decays exponentially as 
f — 5- 00. On the event {fit ^ Cm, t < Tqo}, there exists / > m such that 

(3.17) fit{Bi) = l f\B,{Xs)ds<l-Si 

t Jo 

which is equivalent to 

(3.18) fitiBf) = y flB4X,)ds > 5i. 

t Jo 

Then, we have on {fit ^ Cm, t < Tqo} 

f c{Uo{Xs)+K)ds= f' c{Uo{Xs)+A)lB,{Xs)ds 
Jo Jo 

+ f\{Uo{Xs)+A)lBf{Xs)ds 

Jo ' 

(3.19) >mfc{Uoix)+A) j\Bi{Xs)ds 

+ inf c{Uo{x)+A) f\Bf{Xs)ds 

\x\>l Jo ' 

= (3of^t{Bi)t + /3aH{B!)t, 

where we set (3o = inf^ c{Uo{x) + A) , (3i = inf^^^^i c{Uo{x) + A) . By (A3), there 
exists m > 1 such that 

(3.20) A>0 V/>m. 
So, we obtain from (3.17)-(3.19), 

f\{Uo{Xs) + A)ds>{-\Po\{l-Si) + m)t. 
Jo 
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Take a positive constant M > 0. Then we choose 5i such that M = — |/3o|(l — 
^i) + Pi^i- Indeed, 6i is defined by 

_ M + \Po\ 

' l/3o| + A' 

Then, we have 

(3.21) f\{Uo{Xs)+A)ds>Mt on {fit ^C,n,t< Too}- 
Jo 

By (3.15) and (3.21), 

^{X) > £;,[<^(Xt)e/o ^(^°(^»)+^)'^^/it ^Cm,t< Too] 

Therefore we obtain 

ES{Xty,l^t^C„„t<Too]<Hx)e-^\ t>0. 
By (3.16), we have 

(3.22) rf'V(x) < \\f\\ooPx[f^teCm,t<Too] + ||/r'l|oo0(x)e-*". 
Applying Lemma 3.4, 

lim sup J log [fit eCm,t <Too] < - inf I^{fi), 

where Cm is the closure of Cm ■ Since (fi) is lower semi-continuous and Cm 
is compact in A^i(M^), inf ^gg-^ (//) is attained at some fi* GCm- Since 
existence of invariant measure implies recurrence, it follows from Lemmas 
3.5 and 3.6 and transience of {Xt} 

inf l^{fi)>0. 

Hence, we can find a positive constant Um > such that 

(3.23) Px[f^t^Cm,t<Too]<C{x)e-''"^\ t>0. 
Then, from (3.22) and (3.23), we obtain 

'V(x) < C(x)||/|Ue-"'"* + \\fr'\\ooH^)e-'''. □ 

We are ready to prove that for A = A*, the corresponding diffusion process 
{Xt} is ergodic. 

Theorem 3.7. Let (W*,A*) be a solution of (1.1) corresponding to 
A* =inf^ and let {X;} be a solution of (3.1) for {W*,A*). Under (Al)- 
(A3), {Xt} is ergodic. 
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Proof. Suppose that {X^} is transient. Then, by Proposition 3.3, 

< C(x)e-"* V/ G Co(M^),/ > 0. 

Note that a is a positive constant independent of / and x. Taking < e < a, 
we see that 

r E^[f{X;)e'';t< Too] dt = rTr''''f{x)e''dt 
Jo Jo 

POO 

= C{x) / e-("-^)*(it<oo. 
Jo 

Then, there exists Green function G{x,y) for {l/2)a^^Dij + (6 + aVW*) ■ 
V + e and G{x,y) satisfies the foUowing: 

(3.24) la'WijGi-,y) + (b + dVW*)-VGi;y) + eGi-,y) = in M\{y}. 

We take a sequence {y-n} in such that y„ e Bn+i\Bn- Define 4>n{x) as 
follows: 

T / \_G{x,yn) ^-srs,N\( ^ 

^n{x) = --— -, XGM \{yn}- 

^yJiUn) 

Then, we have from (3.24) 

(3.25) \a'W,,^n + {h + dVW*)-V4>n + e^n = ^ in ]R^\{y„}. 

We note that by setting Wn = (l/c)log0„, (3.25) is equivalent to the fol- 
lowing: 

\'WijWn + ^a'WiWnDjWn + {h + aVW*) ■ VWn + 1 = in ]R^\{y„}, 
where c is taken from Remark 2.1. By Lemma 2.4, we have 

sup I VW^n l < Cr, r <n. 

Br 

Thus, in a similar way to the proof of existence of solutions of (1.1), we can 
see that there exists smooth function W such that 

(3.26) ^a^WijW +(b + aVW*) ■ VW + ^aVW ■ VW + | = 0. 
Since {W*,A*) is a solution of (1.2), 

(3.27) ^a'WijW* + b • VW* + ^dVW* • VW* + y - A* = 0. 
Adding (3.26) to (3.27), it follows from Remark 2.1 that 

= ^a'Wij{W* + W) + b- {VW* + VW) 
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+ ^aVW* ■ VW* + aVW* ■ VW + ^aVW ■ VW + V-(a* 

> ^a'WijiW* + W) + b- {VW* + VW) 

+ ^aVW* ■ VW* + aVW* ■ VW + ^aVW ■ VW + V-(a* 

= ^a'WijiW* + W) + b- V{W* + W) 

+ ^aV{W* + W) ■ V{W* + W) + V - (a* 

Thus, W* + is a super solution of (1.1) for A = A* — e/c. In the same 
way as the proof that given in Section 2 we can see that there exists 
a smooth function W such that 

-a'WijW+ -aVW ■ VW + b ■ VW + V = A*--. 
2^2 c 

This contradicts A* = inf^. Therefore, {-'^f*} is recurrent. 

In order to see that {AT^*} is actually ergodic, we recall the proof of Propo- 
sition 3.3. If we suppose inf^g^^ > where m is chosen in (3.20), we 
can prove Proposition 3.3, which implies that {X^} is transient. Hence, we 
see that 

(3.28) inf l^*{fi) = 0. 

Since Cm is compact, (3.28) is attained at ^* G Cm- Then, it follows from 
Lemmas 3.5 and 3.6 that /i* is an invariant measure for {X^}. □ 

3.2. Uniqueness of solutions corresponding to the bottom. We proved 
that solution (VF*,A*) of (1.1) for A* = inf^ corresponds to ergodicity to 
{Xj*} of (3.1). Now we shall show that the solution corresponding to A* 
is unique up to an additive constant. Note that the solution of (1.1) has 
ambiguity on an additive constant. 

Theorem 3.8. Let W* , i = 1,2, be solutions of (1.1) corresponding to 
A*=inf^. Under (Al)-(A3), there exists constant k such that W^Kx) = 
Wl{x) + k. 

Proof. Since W* , i = l,2, are solutions of (1.2), 

^a'WijWi + ^aVWi ■ VW* + b ■ VW^ + V = A*, 
\a'WijW2 + \aVW2 ■ VW2 + b ■ VW2 + V = A*. 
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Subtracting each side in the above equations, we have 

W^Dij{W^ - W2) + {b + aVW^) • (VW^i - VW2) 

(3.29) 

+ ia(VVFi* - VW2) ■ {VWi - W2) = 0. 

Let us set (p{x) = e'^^^i (^)~^2*(^)), where c is in Remark 2.1. Rewriting (3.29) 
in terms of 4>, we have 

^a'Wijcj) +{b + aVW^) ■V(l) + ^{a-ca)^-V(p = 0. 

Hence it is imphed from Remark 2.1 that 

(3.30) = \a'Wijcp +{h + aVW^) ■Vcp<{). 

Let us take x, y G and consider the SDE of (3.1) for W = W^: 

dXl = {h{Xl) + aVW^{X;)) dt + a{X;) dBt, X^ = x. 

Define tb„ = inf{t ^ aB,{y) = inf{t G Be{y)}. Note that {X^} 
is ergodic from Theorem 3.7, especiaUy recurrent. It fohows from the Ito 
formula and (3.30) that 







+ V(p{X:)-a{X:)dBs 
Jo 

<m+ v<p{x:)-a{x:)dB, 

Jo 



Thus we have Ex[(p{X^/^^^ ^^^)] < (j){x). By taking the hmit as n ^ 00, 
it fohows by Fatou's lemma that E[(j){Xf^^^ ^^^)] < 4>{x). Noting that 
Px[<^B^{y) < C)o] = 1, we have by sending t — > cxo, 

Ex[c^{X:^^J]<c^{x). 

We note again that {-'^j*} hits the boundary of B^{y) in finite time with 
probability 1. Hence we can see that 

(hix) > EJ(h{X* )1 > inf 6. 

Taking the limit as e — > 0, we obtain 

^{y)<^{x), a;,yGR^, 
which implies ^ is constant. Therefore — W2 is also constant. □ 
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Example 3.9. Let us consider the linear case: 

b{x) = Dx; 

a{x) = a, a{x) = a; 

V{x) = ^x ■ Mx + V-X. 

D,M,a,a are matrices and M is symmetric; a, a are positive-definite. We 
consider quadratic solution W, 

W{x) = ^x ■ Kx + e ■ X. 

Then 

KaK + D'^K + KD + M = 0, 

{D'^ + Ka)e + v = 0, 

A = ^tr(aK) + |e • ae. 

If M is negative-definite, then there is a unique solution K such that K is 
nonpositive-definite and D + aK is stable. See [15]. For such K, the equation 
for e can be uniquely solved. The stability of D + aK implies that the 
diffusion 

dXt = {D + aK)Xt dt + a dBt 

is ergodic, a is the square root of a. This implies A defined above is equal 
to A* and W obtained is the unique solution corresponding to A*. We note 
there are also solutions that are not quadratic. 

In particular, in the one-dimensioned case, the equation for K becomes 

oi^2 _^ 2DK + M = d. 
If M < 0, the solution is given by 

K = 

Let 

K_ = 




Then 



D + dK, 
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and 

D + aK+ = ]J (^^y -M > 0. 
Solution corresponding to is W* . 

Example 3.10. In [9, 10], the following conditions are considered: 

(a) a{x) = a{x) = I. 

(b) 6(0) = 0; bj{x) has continuous first-order derivatives, Dibj{x) is bounded 
for all 

(c) There is cq > such that for all x,r/ G W^, t] ■ Db{x)r] < — co|7?p. Here 
Db{x) = {D^bj{x)\j. 

(d) V{x), DiV{x),i = 1,. . . ,d, are bounded. 

Under these conditions, Fleming and co-workers prove that there exists 
unique solution (W, A) satisfying the condition 

|VVF(x)| <-||VV||oo, 
Co 

||Vy||oo = sup3, |VV(x)|. Let {Xt} be the diffusion, 

dXt = ib{Xt) + VWiXt)) dt + dBt. 

Denote 

C=-\\VV\\oc- 

Co 



Then 



d\Xt\^ = 2{Xf b{Xt) + Xt ■ VW{Xt) + ^]dt + 2Xt dBf 



By (a), (c) and the mean value theorem, 

X ■ b{x) < — co|xp. 

Property of W implies 

X ■ VW{x) < c\x\. 

By using a routine argument and considering |Xf p exp(cot), we can prove 

1 / 

E^[\Xt\'^] < exp(-cot)|x|2 + - d + - . 

Cq V Co / 

This implies {Xt} is ergodic. Therefore, A = A* and W = W* . 

In [15], different conditions are considered that are given as follows: 
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(a) ' There are ci, C2 > such that 

ci < a{x) < C2, ci < a{x) < 02- 

(b) ' There are co,ro > such that 

X ■ b{x) < —co\x\'^ , la;|>ro. 

(c) ' aij{x),aij{x) and bi{x) have bounded first-order derivatives. 

(d) ' Vy(x) are bounded. 

Then (1.1) with A = A* has unique solution W* with VF*(0) = 0. Moreover, 
for any a,/5 > 0, there are Ca,/3 such that 

\W*{x)\<a\xf + Ca,f3, 

\VW*{x)\ <a\xf + Ca,i3. 

4. Perturbation of coefficients. In the present section we shall consider 
the structures of solutions of (1.1) under perturbation of coefficients. This 
is to consider the following equation parameterized by n € N: 

(4.1) ^D,{atiDjWn) + ^a'^D,WnDjWn + bn-VWn + Vn = An inM^, 
or equivalently 

^al^D,,Wn + laiiDiWnD.Wn + 6n • VVF„ + K = A„, 

bl^{x)^bl,{x) + ^^Dja'^ix). 
In the same way as (2.1) we define An as follows: 

(4.3) An = {A„; there exists smooth Wn satisfying (4.1) for A„}. 

Under certain assumptions, we can show that An = [A*, 00) for some finite 
A*. Furthermore, we can classify the set An of A„ according to the global 
behavior of diffusion process defined by the SDE: 

(4.4) dXt = ibn{Xt) + anS/Wn{Xt))dt + an{Xt)dBt, an{x) = an{x)^^^ 

where Wn is a solution of (4.1) corresponding to A„ and {Bt} is jF^-standard 
Brownian motion on a filtered probability space {Q,J-',P,{J-'t}). Indeed, we 
can prove that A„ = A* (resp. A„ > A* ) corresponds to ergodicity (resp. 
transience) of {Xt} defined by (4.4) and W* corresponding to A* is unique 
up to additive constants. 

It is interesting to study stability of solution (W^,A*) corresponding to 
the bottom of An under perturbation of coefficients. Suppose that all coef- 
ficients converge to corresponding ones, respectively, in some sense: 

a!f^a*-', a!f^a*-', 6.„ — > 6, Vn^V as n — > 00. 
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We hope to prove that W* and A* converge to W* and A* = inf A, respec- 
tively, where A is defined by (2.1) and W* is a unique solution of (1.1) corre- 
sponding to A*. This means that the solutions corresponding to A* = inf ^„ 
are stable under the perturbation. 

It turns out this is a delicate problem. For the illustration of the idea, 
we shall be content with the following special example. The result obtained 
will be used in Section 5. We refer to [16] for more general discussion and a 
counterexample. 

We now consider the following special example; we consider the following 
equation: 

^a'WijWn + ^a'W.WnDjWn + b ■ VWn + Vn = An, Vn = Vq + K. 

(4.5) 

The equation corresponding to the limit of (4.5) is as follows: 

(4.6) la'WijW + ^a'WiWDjW + b-VW + V = A, V = Vo + V. 

We assume the following conditions. We suppose implicitly that all the co- 
efficients are smooth. 

(Bl) There exists smooth function Wq such that 

Uo = -i^a^^DijWo + ^a'WiWoDjWo + b ■ VWq + Vo)^oo 

as |x| —f oo. 

(B2) Vn, DVn are bounded in M'^ uniformly on n. 

(B3) Vn converges to V uniformly on each compact set as n — oo. 

Let W* (resp. W*) be solution of (4.5) [resp. (4.6)] corresponding to A* 
(resp. A*). 

Proposition 4.1. Under (Al), (A2), (B1)-(B3), A* converges to A*. 

Proof. It is easy to prove that liminf^^ooA* > A*. We shall prove 
limsup„^oo A* < A*. Since W* (resp. W*) is solution of (4.5) for A* [resp. (4.6) 
for A*], 

y'WijW: + ^a'WiW::DjW* + 1 ■ VW: + Vo + Vn = A*n, 
\a'WijW* + \a'WiW*DjW* + b ■ VW* + Vq + V = A*. 
By subtracting both of sides, we have 

\a'Wij{W* - W*) + {b + aVW„*) • V{W* - W*) 

+ \aV{W* - W*) ■ V(VF* - W*) = A* - A*^ + Vn-V. 
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Then, we can see that for c > 0, 
\a'W,,{c{W* - W:)) + {b + aVW^) ■ V{c{W* - W:)) 

+^aViciW* - W:)) ■ V{c{W* - W:)) 

= c{A* - a; + K - y) + l(ca - a)V{c{W* - W:)) ■ V{c{W* - T^„*)). 
If we take c> from Remark 2.1, then 

\a'Wij{c{W* - W*)) + {h + aVW*) ■ V{c{W* - W*)) 
(4.T) ■ _ _ 

+ \aV{c{W* - W*)) ■ V{c{W* - W*)) < c(A* - + K - V). 

Let ;U* be invariant measure of diffusion process Xj*'" defined by the 
following SDE: 

dx;-" = (6 + dvvF,t)(x;'") dt + (j(a:;'") dBt, x*'" = x. 

By the construction of , we see that 

(4.8) /r"«)=o, 

where 

/r"(M) = - inf ^^d^^, f^eMi, 
ueUn J u 

Ln = ^a'W,j + {b + dVW:)-V, 

Un = {u G C^(M^);m(x) > 0,Lnu/u is bounded above}. 
Set u = exp(c(T^* - W*)). Then, from (4.7), we have 

^ = yw^Mw* - w:)) + (6 + dvw:) ■ v{c{w* - w:)) 

(4.9) + \aV{c{W* - W^„*)) • V{c{W* - W*^)) 
<c{K* -Kl + Vn-V). 

Since V, Vn are bounded, u £Un- Hence, by (4.8), 

J u 

Then, the above inequality and (4.9) imply that 

c j {K* - ^l + Vn-v)d^,l>Q. 
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Therefore we have 



We note that {/i^} is tight by the proof of Proposition 3.3. Indeed, {/U* } G 

Cm ) 



Cm = {f^eMiiR'');fiiBi)>l-5i V/>m}, S, 
(3o= mi{Uo{x)+a}, ^ = inf {;7o(x) + a}, 



M+\po\ 
l/9o|+A' 



Uo{x) = - supila'WijWo + iaVWo • VWo + & • VWo + K), 

n 

a = inf A* . 

n 

Wo is from (Bl) and m is taken so that 

/3z>0 \fl>m. 

Since Vn are uniformly bounded and Vn converges to V uniformly on 
compact sets, we can see that 



^ {V -Vn)dfi*^^0 (n^oo). 
Therefore, we have 

limsup A* < A*. Q 

n— >oo 

Theorem 4.2. Let W* (resp. W*) he solution of (4.5) for A* [resp. 
(4.6) /or A*], [/nder (Al), (A2), (B1)-(B3), W* (resp. K*J converges to 
W* (resp. N* ) uniformly on compact sets, H^^^- strongly as n— >oo. 

Proof. By using the estimate of VWn as in Lemma 2.4 and the argu- 
ment in the proof of Theorem 2.6, we can show W* (resp. A* ) converges to 
W* (resp. A*) uniformly on compact sets, //iQj,-strongly by taking a subse- 
quence if necessary. Furthermore (W*,A*) is a solution of (4.6). Indeed, we 
see that A* = A* by Proposition 4.1. By uniqueness of solution corresponding 
to A* in Proposition 4.1, we have W*{x) = W*{x). □ 

5. Representation of A*. For (1.1) with the coefficients satisfying the 
conditions (A1)-(A3), we have proved that there is a unique solution {W* ,A*) 
with W*{<d) = and A = A* is the smallest such that (1.1) has solution W . 
In this section we will give a representation of A*. From the representation. 
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we will get some moment condition for /i* , the invariant measure for the dif- 
fusion in (3.1) constructed from W = W*. Before we state our main results, 
we give some notation. 

We shall consider a family of V. That is, we consider a particular Vq and 
the bounded perturbation of Vq, say Vq + V" for bounded V. Therefore, in 
this section we consider the equation 

(5.1) lDi{a'WjW) + ^a'WiWDjW + b-VW + Vo + V = A in R^. 

The smallest A such that this has solution W is denoted A*{V). We still use 
W* for the solution corresponding to A*{V). We shall mention if we want 
to emphasize the dependence of W* on V. 

In this section we assume the following condition: 

(A3)' Vq is smooth and there exists a smooth function Wq such that 

Uo{x) = -i^Diia'WjWo) + b ■ VWq + ^a'WiWoDjWo + Vo)^oo 

as |x| —I- oo. 

We consider V satisfying the condition: 

(5.2) V is smooth, \V{x) \ < c, \DV{x) \ < c, 

where c is a constant that may depend on V. 
Let Vl^ be a smooth function. We denote 

(5.3) G{W) = ^Diia'WjW) + b ■ VW + \d}WiWDjW + Vq. 
For each probability measure /i on M^, we define 

J(;u) = sup{— (G(VF),/i); is smooth and G{W) is bounded above}. 
Here for a function / 

=y f{x)dfi{x). 
Now we can state our main results. 

Theorem 5.1. Assume (Al), (A2), (A3)' and (5.2). Let {W*,A*{V)) 
be the solution defined above. Then A*(y) has the representation 

A*iV)= sup {{V,fi)-J{^i)}. 

Here A^i(M^) denotes the set of all probability measures on M^. The supre- 
mum attains at 11 = fi* , (i* is the invariant measure of the diffusion in (3.1) 
forW = W*. 
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From this theorem, we have 

K*{v) = {v,^,*)-J{^x*) 

<{v,^l*) + {G{w^),^x*) 

= {V,fi*) + {-Uo,fi*). 
Therefore, we have the following corollary. 

Corollary 5.2. We assume the condition as in the above theorem. 
Then 

J Uo{x)dfi*{x) < -A*{V) + ||F||oo. 

In particular, 

J Uo{x) dfi*{x) < oo. 

Here \\V\\ is the supnorm of V . 

Before we prove Theorem 5.1, we mention some elementary properties 
of A*{V). 

Lemma 5.3. (i) A*{V) is Lipschitz with constant 1. That is, 

|A*(y,)_A*(y2)|<||Vi- halloo 

for Vi,V2 satisfying (5.2). From this, A*(y) can be defined for all bounded 
continuous functions V by extension. 
(ii) A*(y) is convex in V. 

Proof. Let be the solution of (5.1) for V = Vi,A = A*{Vi). Then 
^Diia'WjW^) + ^d'WiW^DjW^ + b ■ VW^ + V0 + V2 
= A*{Vi) + V2-Vi 
<A*{Vi) + \\V2-Vi\\^. 

This implies 

A*(I/2)<A*(l^l) + ||F2-^l||oo. 

See the argument in the proof of Theorem 2.6. Similarly, 

A*{Vi)<A*{V2) + \\V2-Vi\\. 

Therefore, 

\A*iVi)-A*iV2)\<\\Vi-V2\U 
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We now show that A*{V) is convex. Let Vi,V2 satisfy (5.2) and W^, 
k = l,2, satisfy 

lDi{a'WjW!:) + ^a'W,W^D,W^ + b-VWi: + Vo + Vk = A*{Vk), k = l,2. 

Let < A < 1 and denote W = XW{ + (1 - X)W^ , V = XVi + {I - X)V2 and 
A = AA*(Vi) + (1 — A)A*(V2)- Then by a simple calculation, we have 

\Di{a'WjW) + \a'WiWDjW + h ■ VW + Vq + V <K, k = l,2. 

This implies 

A*(y) < A. 

See the proof of Theorem 2.6. That is, we have 

A*{XVi + (1 - X)V2) < XA*iVi) + (1 - A)A*(V2). □ 

Denote by Cb{M.^) the collection of all bounded continuous functions de- 
fined on R-^. Cb(M'^) is a Banach space with sup norm. The dual space 
C;,(M^)* can be identified with the set of all regular bounded finitely addi- 
tive set functions defined on the field generated by closed sets of M^. That 
is, for an element Cfe(M^)*, there is regular bounded finitely additive 
set function fi such that 

T{V) = J V{x) dfi{x), V G Cb(M"). 

See [6], Theorem IV. 6. 2. For regular additive function see [6], Theorem 
IIL5.11. We note that Xi(M^) is a subset of ^(M^)*. 
For /i G Cb(M^)*, we define 

I{^x)= sup {(y,M)-A*(y)}. 

Proposition 5.4. Let V he hounded continuous. Then 

k*{v)= sup 

AteCi,(M^)* 

See [7], Proposition 4.1, Chapter 1 or [23], Theorem 7.15. 

We shall prove that /(/i) = -/(z^) if /i is a probability measure. For V sat- 
isfying (5.2), the supremum is attained at = /i*, where /x* is the invariant 
measure of the diffusion in (3.1) for W = W* . Our main theorem is a con- 
sequence of this. We begin with some elementary observations. We follow 
essentially the argument in [23]. 

Lemma 5.5. If I{fi) < oo, then is nonnegative and fi{M.'^) = 1. 
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Proof. We first prove I{fi) = oo if ;U is not nonnegative. For sucli /x, we 
take V >0 such that fj,{V) < 0. For any a > 0, 

> {-aV,fx) -A*{-aV). 
Now A*{-aV) < A*(0), since -aV < 0. Therefore, 

> -a{V, fi) - A* (0) ^ oo 

as a tends to infinity. Hence I{fJ.) = oo. 

We now prove = oo if /u(M^) ^ 1. For such /i, 

> {a,fi) -A*{a)=afi{R^)-a-A*{0) = a{fi{R^) - 1) - A*(0). 

Here a is any real number. From this, it is easy to see that = oo. □ 

Lemma 5.6. Let fi be a probability measure. Then I{fJ,) > JifJ-)- 

Proof. Let be a smooth function such that G{W) is bounded above. 
Take 

Vn = imn{- G{W),n}. 

Then Vn is a bounded continuous function. 
It is easy to see that 

\Di{a'WjW) + \a}WiWDjW + b ■ VW + Vo + K < 0. 

Therefore, A*{Vn) < 0. From the relation 

/(^)>(K,/i)-A*(K)>(K,/i), 

and Vn — > — Vn < Vn+i such that Vn are bounded below, we can apply 
the monotone convergence theorem to get 

m>-{G{w),^l). 

Then 

I(^) > sup{-(G(t^),/i); is smooth, G{W) is bounded above} = J(/i).n 
Lemma 5.7. Let V G Cb{M.^). Define 

r{v)= sup {{v,^l)-J{^Ji)}. 

Ate7Mi(]R'V) 

Then J*{V)<A*{y). 
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Proof. It is enough to prove this for V satisfying (5.2) which we assume 
now. We first observe the relation 

J*(y) = sup|(y,^) +inf{(G(W),/.)}| 

= supmU{GiW) + V,fi)} 
fj. w 

<infsup{(G(W) + y,/i)} 
W fi 

= inf sup {G{W){x) + V{x)}. 

Here the fx, W are taken over all those satisfying /i G A^i(]R^) and W smooth 
with G{W) bounded above. Let W* be the solution of (5.1) for A = A*{V). 
Take W = W* in the above relation; we have J*{V) < A*{V). □ 

Lemma 5.8. Let V satisfy (5.2) and let /u* be the invariant measure of 
the diffusion in (3.1) for A = A*(y) and W* the solution of (5.1). Then 

A*{v) = {v,t,n-i{^n. 

Proof. We need to prove that 

{V',fi*)-A*{V') < {V,iJ.*)-A*{V) 

for all V e Cb(M^). This is equivalent to 

A*{V') - A*{V) > {V -V,n*), V' e a(M^). 

Since A*(-) is a convex function on Cb(M^), there is a subgradient 
fi € Cb(]R^)* of this function at V such that 

A*{V') - A*{V) > {V -V,fL), V'e Cb{R^). 

See [7], Proposition 5.2, Chapter 1. We only need to prove p. = /i*, since this 
implies the claim. 

First, the nondecreasing of A*(-) implies /2 is nonnegative. 

Applying the above relation to V = V + a, a is constant, and using 
A*{V + a)= A*{V) + a, we can easily deduce /i(]R^) = 1. 

Now take (pn smooth functions on satisfying the following properties: 
< 0n ^ 4'n+i < Ij 0n has compact support, V(^„ are bounded uniformly in 
n, (pn^ ^ uniformly on compact sets. Then Proposition 4.1 implies A*(y + 
ac^n) ^A*{V + a)= A*(y) + a as re ^ oo. Then 

limsupa(i;^)n,/u) < a 

n—*oo 

for all a. Prom this, we have 

lim (1 - 4in,fi) = 0. 
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Then p, must be a probability measure. This is a consequence of [6], Theo- 
rem III. 5. 13. 
We now prove 

{^a'^{x)DijW{x) + {b{x) + aVW*{x)) ■ VW{x)) dfl{x) = 

for W smooth function on M" with compact support. This imphes p, is an 
invariant measure of the diffusion in (3.1). Hence fl = fJ.* by the uniqueness 
of the invariance measure. To prove this last statement, we take such W and 
consider 

V' = V- {\a'W,jW + {h + aVW*) ■ VW + \a}WiWDjW). 
Then by a simple calculation, we see 

\a'Wij{W + W*)+b- V{W + W*) 

+ \a'^Di{W + W*)Dj{W + W*) + Vo + V' = K*{V). 

Therefore, A*{V') = K*{V). Then, 

> (y' - V,p) = -ila'WijW + (b + aVW*) • VW + la'WiWDjW,p,). 

We replace W by aW, a > 0, divide the relation by a and let a tend to 0. 
We get 

-{la'WijW + {b + aVW*)-VW,fi)<0. 
We replace W by —W. Then we find 

{^a'WijW+ (6 + aVW*)VW, Jx) = 0. 
This is what we want to prove. □ 



Corollary 5.9. Let V G Cb(M^). Then J*{V) = K*{V). Let n be a 
probability measure. Then /(/x) = J(/u) . 

Proof. We assume V G C;,(M^) satisfying (5.2). Let /i* be the invariant 
measure for the diffusion in (3.1) with W = W* . Then 

r{v) > {v,fi*) - > {v,f,*)-i{fi*) = A*{v). 

But we have already proved J*{V) < A*{V). Therefore, they are equal. 
We now prove L{fi) = J{^). We use the relation 

j(/.)= sup {{v,ti)-r{v)}. 



See [23], Theorem 7.18. By definition, 

I{^x)= sup {(y,M)-A*(y)}. 

Since J*{V) = K*{V) for all V, we have /(^t) = J(^). □ 
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